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Abstract We applied latent class analysis and the rule space model to verify the cumulative 
characteristic of conceptual change by developing a learning progression for buoyancy. For this 
study, we first abstracted seven attributes of buoyancy and then developed a hypothesized learning 
progression for buoyancy. A 14-item buoyancy instrument was administered to 1089 8th grade 
students to verify and refine the learning progression. The results suggest four levels of progression 
during conceptual change when 8th grade students understand buoyancy. Students at level 0 can 
only master Density. When students progress to level 1, they can grasp Direction, Identification, 
Submerged volume, and Relative density on the basis of the prior level. Then, students gradually 
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master Archimedes’ theory as they reach level 2. The most advanced students can further grasp 
Relation with motion and arrive at level 3. In addition, this four-level learning progression can be 
accounted for by the Qualitative-Quantitative—Integrative explanatory model. 


Keywords Buoyancy - Learning progression - Latent class analysis - Rule space model - 
Conceptual change 


Introduction 


The conceptual change among physics students is a result of the learning process (Posner et al. 
1982). To uncover how the conceptual change occurs has been a great challenge for science 
educators since the 1980s. Based on the studies of Piaget (1930, 1969) of how students 
develop scientific explanations, multiple assumptions were proposed to model this complex 
cognitive evolution process. The core divergence of these assumptions lies in how the 
knowledge status progresses from novice-like to expert-like. Among the many studies on this 
topic, diSessa (2013) and diSessa et al.’s (2004) contributions stand out. Unlike other 
assumptions such as theory theories, which assume that the understanding of the physical 
world among students is a spontaneous process marked by equal pace (McCloskey 1983a, b), 
diSessa (1988) asserted that concepts were fragmented initially but eventually became inte- 
grated as learning occurred. The conceptual change was marked by the integration of more and 
more pieces of knowledge into a coherent and structured entity (diSessa 2013; diSessa et al. 
2004). For example, to understand Ohm’s law, one first abstracts a series of key attributes such 
as resistance from a common experience—Pushing a box with variable effort on different 
surfaces, and then gradually integrates them to formulate a more sophisticated understanding 
of Ohm’s law (diSessa 1988). The accumulation accompanied with an integration of these 
kinds of attributes indicates conceptual change (diSessa 2007, 2013). 

Besides the studies of diSessa and his colleagues, other prevalent theories toward conceptual 
change also indicated this accumulative characteristic. For example, Norman and Rumelhart 
(1981) discerned accretion as one of three main categories of conceptual change. They 
contended that student understanding of certain concepts changed as knowledge accumulated. 
The difference to diSessa was that they did not explicitly point out that knowledge was 
fragmented. She (2002) supported this point of view and stated conceptual change as a “gradual 
accretional phenomenon rather than a Kuhnian scientific revolution” (p. 982). Another influ- 
ential theory asserted that students embraced an explanatory framework primitively and then 
reconstructed the framework, which also acknowledged the accumulative characteristic 
(Vosniadou 1994; Vosniadou and Brewer ; Vosniadou et al. 1987). Chi (1992) and Chi et al. 
(1994, 2003) differentiated two kinds of conceptual change—the Compatibility Hypothesis and 
the Incompatibility Hypothesis. Specifically, the Incompatibility Hypothesis assumes that the 
existence of a mismatch between students’ naive conceptions and the ontological category to 
which a science concept truly belongs results in students’ difficulty in learning this scientific 
concept. The Compatibility Hypothesis predicts that conceptions should be relatively easy to 
learn if students’ naive conceptions are compatible with the scientific conceptions. In addition, 
this conceptual change was accompanied with the accumulation of knowledge as well (Chi 
et al. 1994). In sum, while “some major debates” (Taber 2010) remain in the research field of 
conceptual change, nevertheless, the cumulative characteristic of the cognitive process draws 
upon a consensus among the main conceptual change theories in science education. 
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Despite this, studies on conceptual change seldom capture the cumulative process to uncover 
the progress patterns of conceptual change empirically. We surveyed four review studies 
discussing conceptual change that cover the literature ranging from 1987 to 2016 (Guzzetti 
1993; Mills et al. 2016; Soto Lombana et al. 2005; Taber 2010), among which one only focused 
on instructional issues and one only focused on qualitative research on conceptual change. A 
systematic analysis of the relevant studies suggested that researchers focused on modeling the 
process of conceptual change mainly before the year of 2000, and Soto Lombana et al. (2005) 
review confirmed our claim since they found that 76.9% of these kinds of studies appeared 
between 1996 and 2000. Excluding the two reviews, we traced the remaining two review studies 
and found that they documented 26 studies that focused on the modeling of conceptual change 
(Soto Lombana et al. 2005; Taber 2010). In-depth inspection indicated that most of them were 
qualitative or theoretical studies, and no study empirically modeled the cumulative property of 
conceptual change. Hence, no study considered in these reviews modeled the cumulative property 
of conceptual change in physics. Drawing upon these research gaps, we conducted a quantitative 
study by collecting 1089 8th grade students’ data to model the cumulative characteristic of 
conceptual change in physics learning, specifically focusing on the concept of buoyancy. 

To achieve the goal of modeling the cumulative characteristic of conceptual change, we 
developed a learning progression—used to model “increasingly sophisticated ways of thinking 
about or understanding a topic” (National Research Council 2007)—for the understanding of 
buoyancy. We first abstracted seven attributes of the concept of buoyancy and theoretically 
developed a hypothesized five-level learning progression by accumulating more attributes to 
higher levels. To empirically validate the learning progression, we employed latent class 
analysis (LCA) and the rule space model (RSM). Two research questions lead this study: 


1. Can the cumulative characteristic of conceptual change be modeled by a learning 
progression? 

2. Ifit can, what patterns do students show in the process of conceptual change in terms of 
understanding buoyancy? 


In the following, we give an overview of the concept of a learning progression and then 
theoretically develop a hypothesized learning progression for buoyancy. Last, we describe how 
LCA and the RSM will be used in validating and modifying the learning progression. 


Learning Progression 


The idea of learning progressions stems from a much older idea—conceptual change (Wilson 
2009). However, the studies on learning progression highlight both the developmental and 
cognitive features, whereas the studies on conceptual change were more concerned about 
cognitive features. Specifically, learning progressions would inform both curriculum and assess- 
ment development (Songer et al. 2009). For curriculum development, learning progressions 
provide evidence for the sequences of curricular units. For assessment development, learning 
progressions-based assessments not only describe students’ present level but also point out their 
learning path. Therefore, a learning progression carries forward the objective of the studies in 
terms of conceptual change. Since the first published learning progression by the National 
Research Council (NRC; Wilson and Bertenthal 2005), many studies have been conducted to 
explore students’ progression in understanding a specific body of knowledge such as energy 
(Neumann et al. 2013), force and motion (Alonzo and Steedle 2009), and matter (Stevens et al. 
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2010; Talanquer 2009). The potential of a learning progression in mapping students’ progression 
in conceptual change had been empirically validated. These empirical studies usually focused on a 
big idea in science, covering a large time span. However, learning progressions with a large time 
span are difficult for teachers to use in the classroom (Alonzo and Gearhart 2006). Therefore, short 
time span learning progressions that focus on modeling students’ understanding of a specific 
concept such as buoyancy are valuable, especially from a classroom perspective. 

Developing a learning progression starts by defining the upper anchor, lower anchor, and the 
“messy middle”—that is, to formulate a hypothesized learning progression theoretically (Stevens 
et al. 2010). The second step is to empirically validate and to refine the hypothesized learning 
progression. Neumann et al. (2013) summarized two approaches to validate a learning progres- 
sion. First, by inserting measurement tools into the instructional interventions, the researchers 
were able to capture the students’ conceptual change at different time-points. In order to pursue 
such an objective, the researchers have to develop different measurement tools according to the 
interventions. However, it is difficult to establish high fidelity between the intervention and the 
assessment tool and therefore this approach is seldom used in the literature. The second approach 
is to develop a measurement tool focusing on the whole learning progression. The items in the 
measurement tool should be anchored to specific levels of the learning progression. Then, 
researchers can employ for example a Wright map to map students’ understanding to the specific 
levels (Wilson 2005). Any incompatibility of the expected item difficulty and the empirical 
difficulty would suggest revision and more rounds of validations. To date, most learning 
progressions followed the latter approach, as does the current study. 

Before following the second approach mentioned above, we should note its limitation. It is 
not a method that directly tracks the progression of a student in understanding a scientific 
concept within a time span. Instead, it is a cross-sectional study that groups students into 
different levels of understanding but employs the same time frame (Neumann et al. 2013). 
However, this limitation was broadly accepted in the prior studies in terms of developing 
learning progressions (Alonzo and Steedle 2009; Chen et al. 2016). The advantages of the 
method outweigh the limitations since the approach allows researchers to employ a large 
sample size to statistically explore the change or progression in the understanding of a 
scientific concept. Drawing upon this advantage, we followed the second approach. 


Theoretically Developing a Hypothesized Learning Progression of Buoyancy 


The traditional approach to developing a learning progression usually refers to the curriculum 
standards to determine the upper anchor, whereas a literature review in terms of students’ 
misconceptions is done to set the messy middle and the lower anchor (Duschl et al. 2007; 
Neumann et al. 2013; Smith et al. 2006; Stevens et al. 2010). Such an approach meets the general 
requirement of a learning progression development, but it does not in detail describe the steps in 
the learning progression. For instance, Stevens et al. (2010) developed a learning progression to 
model the nature of matter, in which they declared “building conceptual understanding involves 
taking newly introduced information and connecting it to existing knowledge as the student builds 
an organized and integrated structure” (p. 689). However, they followed the before-mentioned 
traditional approach to develop the hypothesized learning progression. This is difficult ifthe intent 
is to identify the cumulative characteristic, especially when some students are outliers. Compared 
to the traditional approach, our method was more straightforward. We first abstracted seven 
attributes and then analyzed their hierarchical relationship. A hypothesized learning progression 
was proposed by accumulating the attributes students mastered. 
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Before proceeding to do other work, we want to revisit the idea of physical concept and to 
consider how these come into being. According to Piaget’s (1930, 1969) long-term work, it has 
been a commonplace belief that concepts were formalized especially when people try to explain the 
reason and detect causality for some naturally occurring phenomena. diSessa (1988, 1993) used the 
agent—patient relation to explain and predict a particular circumstance. An agent means the impetus 
or a kind of activity which produces some sort of qualitative relationship. A patient is an object in 
whose behavior the effect of the agent’s action is at issue. For example, when people conceptualize 
force—a kind of interaction—they must put the concept in a familiar situation like “I pull the stone, 
and it moves.” In this example, Z is the animate agent and the stone is the patient, whereas pull is the 
legitimized interaction and move is the causal result. Without the agency, force is difficult to 
conceptualize. In this sense, conceptualization of a physical concept involves specific agency or 
might also require the specific circumstance. This claim is essential for classroom students to 
develop their initial fragmented knowledge of buoyancy and eventually integrate it into a scientific 
concept. It will be difficult for a student to formalize buoyancy without agencies such as objects and 
liquid, and only thanks to a causal circumstance such as sinking or floating can they construct the 
concept. Applying these arguments to our own study, we set our physical concept “buoyancy” in a 
causal circumstance with typical agencies—objects sink and float in liquid or gas (Sahin and Cepni 
2012). We then probed how the understanding of buoyancy progresses in students. 


Abstract the Attributes of Buoyancy 


The attributes of buoyancy were determined from the student-learning perspective. Therefore, 
we considered both the nature of buoyancy and the factors that influenced students’ under- 
standing of buoyancy. Two important factors were recognized when we abstracted the 
attributes—the hierarchical property and misconceptions (Joung 2009; Sahin and Cepni 
2012; She 2002, 2005). The hierarchical property helps to recognize the relevant sub- 
concepts of buoyancy, whereas the misconceptions help to identify the critical issues that 
influence students’ understanding. She (2002) first recognized buoyancy as a hierarchical 
concept, which subsumed underlying concepts such as density, submerged volume and 
displaced liquid. In her empirical study, She (2002) concluded that the hierarchical property 
was a crucial factor influencing students’ conceptual change. Drawing upon this hierarchical 
property, three attributes of buoyancy were extracted: (1) the water particles exert forces on 
every side of an object, of which the vertical net force is the buoyancy; (2) the buoyancy is 
equal to the weight of the fluid displaced by the object; (3) a number of sub-concepts are 
related to floating and sinking such as the density of the object, the density of the liquid, and 
the submerged volume. 

Yin (2005) and Yin et al. (2008a, b, 2014) recognized four sets of sub-concepts of buoyancy— 
mass or volume, mass and volume, object density, and relative density. These four sets of sub- 
concepts form a complex four-level hierarchical structure. They argued that students’ understand- 
ing of buoyancy would follow such a trajectory—from a lower level to a higher level, which will 
also indicate the sequence of the attributes in the next part. 

Besides the hierarchical property, we also recognized misconceptions as another main factor 
when abstracting the attributes of buoyancy. Misconceptions among students are common before 
they receive formal instruction (National Research Council 2001). Since buoyancy is one of the 
most challenging concepts for students, many studies have examined misconceptions of buoyancy 
(Havu-Nuutinen 2005; Loverude et al. 2003; Maclin et al. 1997; She 2002, 2005; Smith et al. 1985; 
Yin et al. 2008a, b). For example, Yin et al. (2008b, 2014) summarized ten misconceptions around 
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the phenomenon of sinking and floating, like the misconceptions that heavy objects and objects ofa 
large size would sink. 

We did a broader review and found some additional misconceptions about buoyancy. Unal and 
Costu (2005) examined 120 eighth-grade students’ understanding of buoyancy in terms of sinking 
and floating and found (1) students have difficulty in understanding density, which was regarded 
as a sub-concept of buoyancy. For example, approximately 19% students regarded the density of 
an object hanging in a liquid to be equal to that of a floating object, and 17% students believed 
“Density is the weight of an object in a liquid”; (2) students met difficulty in comparing the 
density between the emerged object and the liquid. About 6% students even believed “The density 
of an object hanging in a liquid is less than the density of the liquid”; (3) about 25% students had 
difficulty in identifying the magnitude of buoyancy by differentiating an object’s states. One 
misconception is that students think the magnitude of buoyancy is greater when the floating part 
of an object is greater. In addition, when comparing buoyancies of three objects which are in 
different states, such as sinking, hanging, and floating, they think the buoyancy of the sinking 
object is more than the others. If students can develop the relationship between an object’s state 
and forces acting upon it, they can make the correct calculation and comparison between 
buoyancy and gravity. The study of Sahin and Cepni (2012) added two more misconceptions. 
The first one was about the identification of buoyancy, which was stated as “buoyancy force 
affects objects floating in the fluid, fluid buoyancy force does not affect objects submerged in the 
fluid and buoyancy force affects moving objects.” The second one was about the direction of the 
buoyancy. Their study suggested that students might confuse the direction of buoyancy with the 
direction of gravity, especially when an object was sinking. In addition, even though some 
students know the direction of buoyancy is upward, they cannot figure out whether it is 
perpendicular to the ground or to the container (Shao and Liu 2017). 

Accordingly, we abstracted seven attributes of buoyancy. From the hierarchical property 
perspective, we abstracted Density, Submerged volume and Relative density. We did not add 
multi-level sub-concepts such as volume or mass as Yin (2005) and Yin et al. (2008a, b, 2014); 
rather, we incorporated volume and mass into Density and Submerged volume. We also 
adapted She’s (2002, 2005) second attributes as Archimedes’ theory since the curriculums in 
China require students to calculate the buoyancy mathematically. From the misconception 
perspective, we abstracted Direction, Identification, and Relation with motion. We also realized 
that the hierarchical property perspective was related to the misconception perspective. That 
means that the sub-concepts also caused misconceptions. For example, there are many 
misconceptions around the sub-concepts density, submerged volume, etc. Therefore, we 
argued that these two perspectives are intertwined when we abstracted the seven attributes. 
The operational definitions of the attributes are given in Table 1. 


Sequence the Attributes of the Buoyancy into the Hypothesized Levels 


To sequence the attributes of buoyancy into the levels of the hypothesized learning progression, we 
first referred to another study conducted by our group member that aimed to detect the relationship 
of the same seven attributes (Chen 2015), and then organized a panel including physics educators 
and physics teachers to discuss and formulate the initial learning progression. Chen (2015) first 
formulated the initial relationship of the seven attributes theoretically and then employed a think- 
aloud approach to verify and refine the assumption. She collected data from six 8th grade students 
by employing eight open-ended items. The results indicated that attributes Al and A2 formed the 
basis of A5, whereas A3 was the basis of both A6 and A7, and A4 was the basis of A6 (Fig. 1). 
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Table 1 Seven attributes of buoyancy and their operational definitions 


Attribute Operational definition 

Al Direction Know that buoyancy is vertically upward 

A2 Identification Can identify not only gravity but also buoyancy that is exerted 
on an object when it is floating, hanging, or sinking in liquid 

A3 Density Know that density is a property of an object, which is equal to 


mass divided by volume and will not change even though the 
mass or the volume changes 


A4 Submerged volume Understand the relationship between submerged volume in water 
and actual volume 

AS Relation with motion Can develop the relationship between the magnitude of buoyancy 
and the state of motion 

A6 Archimedes’ theory Can employ Archimedes’ theory to calculate buoyancy 

A7 Relative density Can judge floating and sinking by comparing the densities 


of the object and of the liquid 


The panel first reviewed the relationships between the seven attributes and then 
discussed the patterns of students’ understanding and the attributes in each level. Besides 
following the cumulative assumption, the panel also developed the levels according to the 
explanation model: Intuitive—Qualitative—Quantitative—Integrative. Their main viewpoints 
included the following issues. 

First, even before instruction, students could identify some attributes according to 
common experience. For example, the word buoyancy in Chinese indicates upward 
tendency or up thrust; therefore, Chinese students usually did not meet trouble to 
identify the direction of buoyancy (Al). Therefore, Al was assigned to the intuitive 
level 0. Second, previous studies (Yin 2005; Yin et al. 2014) indicated that students 
preferred to use mass or volume to analyze sinking or floating even before instruction. 
However, considering that the students in our study had learned density prior to 
buoyancy, the students should prefer to use density or relative density to qualitatively 
explain sinking and floating. Therefore, they assigned the attributes A3 and A7 into the 
qualitative level 1. Third, in level 2, the quantitative level, the students should be able 
to employ Archimedes’ theory to calculate the magnitude of buoyancy. Clement (2008) 
argued that the quantitative mental modeling was usually more complex than qualitative 
mental modeling. Finally, the panel asserted that the integrative level should indicate 
the relationship between buoyancy and motion. Force and motion is a big idea that 
requires students to understand not only buoyancy but also other forces such as gravity 
and also Newton’s law. Considering this complexity, the panel split students’ under- 
standing of force and motion into two levels. The attribute A2 is added to level 3. This 
attribute indicates that students should be able to identify the buoyancy by observing 


Fig. 1 The relationship of the 
seven attributes 
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the motion of an object. Although this level requires a higher ability, it is qualitative. 
Whereas in the higher quantitative level—level 4, students should be able to quantita- 
tively establish the relationship between buoyancy and motion. This level is higher than 
the prior level. Thus, we obtained the hypothesized learning progression and its 
corresponding attributes (Table 2). 


Validating Learning Progression 


The central concept of latent class analysis is that the population of interest is composed 
of unobserved classes. This approach is well suited for analyzing learning progression 
data because it aligns closely with the notion that students can be classified into one of 
several progression levels that explain their responses. It has also been broadly applied 
and discussed in learning progression research (Fulmer et al. 2014; Steedle and 
Shavelson 2009). There are two kinds of latent class analysis that depend on different 
assumptions: confirmatory analysis and exploratory analysis. In this study, we use an 
exploratory analysis, which can determine the number of latent classes that would 
provide us evidence for suitable progression levels. 

Through latent class analysis, we can only partly verify the initial learning progression. We 
still cannot ensure the specific attribute mastery pattern (AMP) established in our learning 
progression hypothesis. To move forward, we proceed with a rule space model analysis that 
has been used in learning progression (Chen et al. 2016, 2017). The rule space model 
(Tatsuoka 1983) is one of the cognitive diagnostic models that can provide students’ profiles 
on skills or attributes through the observed item responses. It begins with a Q matrix that 
indicates the relationship between items and attributes. Students are then classified into 
different attribute mastery patterns (AMPs). For more details on the application of RSM to 
learning progression, see Chen et al. (2016). According to the result of latent class analysis 
with rule space model analysis, we can answer the two research questions in this study. 


Method 
Item Design 


According to the AMP of each learning progression level, physics researchers, physics 
teachers, and measurement experts collaborated to recruit, revise, and produce items for 
each level. Most items involved more than one such attribute, whereas a few items 
possessed only one attribute. For instance, item 3 involved attributes 3 and 4, while item 
1 only involved attribute 1. After a pilot test, 14 multi-choice items were included in the 
final Buoyancy test (see Appendix), with one item at level 0, three items at level 1, four at 


Table 2 Hypothesized learning 


progression and its corresponding Level Al A2 A3 A4 AS A6 A7 
attributes —C 
0 x 
1 x x x 
2 x x x x x 
3 x x x x x x 
4 x x x x x x x 
a Springer 
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level 2, two at level 3, and four at level 4 (Table 3). In addition, these items examine 
students’ different attributes. For instance, item 1 only involves Al, while item 14 
examines all seven attributes. We assumed that the items at each level were able to 
differentiate students that were located in a certain level from those located in the 
neighboring levels. For instance, an individual L who was categorized in level 1 should 
have a lower probability of mastering the level 2 items than an individual H who was 
categorized at a higher level. However, no significant difference should be observed in 
terms of the probability to correctly answer the level 1 items for L and H. In this test, each 
item was dichotomously scored as “1” for correct and as “0” for incorrect. 


Participants and Data Collection 


We recruited 1089 grade eight students to attend this test in ten middle schools located in 
five east coast cities in China. All students used identical textbooks and all had formally 
learnt the buoyancy concept in their science class by the time the test was taken. All 
students took a 40-min test. They were promised that their personal information would 
remain private. Tests in different schools were not conducted at the same time because of 
a restricted number of test administrators. However, the schools did not communicate 
about the test, ensuring the validity of the results. After deleting invalid subjects with 
blank questionnaires, 1036 were left. Among these participants, there are 51.1% boys, 
48.6% girls, and 0.3% unknown. 


Data Analysis 


We first examined the psychometric quality of the test under the Classical Test Theory (CTT) 
framework by employing SPSS 20.0. Latent class analysis was conducted to partly verify the 
initial hypothesized learning progression corresponding to our first research question. In this 
analysis, a series of models with three, four, five, and six classes were estimated using Mplus 7 
(Muthén and Muthén 2012). The model with the best model fit according to the Bayesian 
Information Criterion (BIC) was chosen for the learning progression verification (Schwarz 
1978). Lastly, we used the rule space model analysis to identify the specific AMP for each 
level to address the second research question using MATLAB code (Li et al. 2009). 


Table 3 Hypothesized learning 


progression level and its corre- Level Item Al A2? A3 A4 AS A6 AT 
sponding items 
0 1 1 0 0 0 0 0 0 
1 3 0 0 1 0 0 0 0 
5 0 0 1 0 0 0 1 
6 0 0 1 0 0 0 1 
2 4 0 0 0 1 0 0 0 
12 1 0 1 1 0 1 1 
10 0 0 1 1 0 1 0 
9 0 0 1 1 0 0 0 
3 2 0 1 0 0 0 0 0 
13 1 1 1 1 0 1 1 
4 7 1 1 0 0 1 0 0 
8 1 1 0 0 1 0 0 
11 1 1 1 0 1 0 1 
14 1 1 1 1 1 1 i 
D Springer 
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Results 
Reliability Analysis 


The CTT framework takes the percentage of correct response as the item difficulty parameter 
and the item-total correlation as the item discrimination parameter. A good item is identified by 
an item difficulty value that is not too high (<0.70) or not too low (> 0.30), or a high item 
discrimination value. The common cut-off criterion for item discrimination is 0.20 (Ebel 
1965). The obtained parameters are found in Table 4. The difficulty indices of all items are 
above 0.30, with an average of 0.67 (SD = 0.17). But five of these items difficulty values are 
higher than 0.70, indicating they are too easy for students. In the framework of CTT, difficulty 
value can be greatly affected by the sample. It is worth noting that students had been taught 
these contents when they took test in this study. This may explain why some items are so easy 
for students. However, even though these items are easy, we still need to include them in the 
test to guarantee the completeness of test content. The discrimination indices of all items are 
above 0.20, with an average of 0.60 (SD =0.15), satisfying the cut-off criterion. 


Latent Class Analysis 


To verify the hypothesized learning progression, we conducted a latent class analysis with 
three, four, five, and six clusters. Based on statistical fit in terms of BIC and a bootstrapped 
likelihood ratio test, the five-cluster model demonstrated the best fit to the data (Table 5). 

Therefore, we employed the five-cluster model to verify our assumption. Specifically, an 
item was indeed being “at the level” if it supported an interpretation that students who reach 
that level would be able to solve or complete the task, whereas students at the lower levels 
would be unlikely to be successful. To verify these items, the conditional probability table 
was examined (Table 6) which showed the probability of correctly answering items of each 
level. For example, item 3 was supposed to examine A3 of level 1, so this item should 
discriminate students who were at level 0 and level 1. As shown in Table 6, cluster 1 students 
have a lower probability (0.364) than students in cluster 2 (0.959). After examining all 14 
items, we concluded that all these items had good performance discriminating students 
between clusters. Also, we concluded that students at cluster 1 are at level 0, students of 
cluster 2 are at level 1, and so on. Analysis of variance (ANOVA) was used to investigate 
differences in personal total score with respect to students in different progression levels. 
The result showed students in these different levels are indeed statistically significant, F(4, 
1031) = 2592.943, p < 0.000, 7° = 0.91. 


Table 4 Item difficulty and item discrimination from the CTT analysis 


Item Difficulty Discrimination Item Difficulty Discrimination 
1 0.944 0.342 8 0.616 0.456 

2 0.597 0.687 9 0.671 0.582 

3 0.891 0.466 10 0.620 0.697 

4 0.710 0.534 11 0.556 0.681 

5 0.847 0.587 12 0.663 0.813 

6 0.903 0.412 13 0.542 0.835 

7 0.561 0.645 14 0.318 0.718 

a Springer 
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Table 5 Latent class analysis fit 


statistics (V= 1036) Model a BIC 
3-cluster 3743.037 12,378.840 
The values in bold indicate that the 4-cluster 3295.755 12,315,715 
5-cluster 3087.992 12,295.343 
five-cluster model fits to the data 


6-cluster 3090.687 12,336.599 
best si SS 


Rule Space Model Analysis 


To illustrate how students of different levels progress when learning the concept of buoyancy, we 
classified these students into different AMPs according to the Mahalanobis distance. Result showed 
that 1036 students were classified into 37 AMPs. None of the students were classified into AMP 1 
(0000000), AMP 5 (0001000), and AMP 24 (0111000). Almost 50% of students were classified 
into three AMPs: AMP 35 (1111101), AMP 39 (1111011), and AMP 40 (1111111). Specifically, 
there were 6.7% students in AMP 35 who had mastered all six attributes but A6, 11.3% students 
who were distributed to AMP 39 have attained six attributes except A5, and 30.9% students who 
had already mastered all the seven attributes. This result indicates that almost half of students in this 
test have a good understanding of these attributes after their respective learning sessions at school. 

Then, we summed up and compared different kinds of AMPs in each level (Table 7). Students 
of level 4 are classified into three AMPs. Most students are in AMP 40 (1111111). Students of level 
3 are classified into ten AMPs, but there are some AMPs that include only a very small amount of 
students such as AMP 27 (1101100) with only one student. We deleted such AMPs that had 
students less than the average amount (The average of level 3 = 235/10). The same procedure was 
applied to levels 2, 1, and 0. After deletion, there are three AMPs left in level 3. As Table 7 shows, 
most students in level 3 are in AMP 39 (1111011). Students of level 2 are also mainly classified into 
three AMPs and most students are in AMP 37 (1011011). Students of level 1 are mainly classified 
into nine AMPs. Most students are in AMP 38 (0111011) and AMP 30 (1011001). Students of 
level 0 are mainly classified into ten AMPs and most students are in AMP 8 (0010001). 


Table 6 Latent class analysis results 


Level Item Response Latent variable 


Cluster = 1 Cluster = 2 Cluster = 3 Cluster = 4 Cluster = 5 


0 1 1 0.773 0.931 0.926 0.988 0.994 
1 3 1 0.364 0.959 0.991 0.954 0.986 
5 1 0.171 0.87 0.957 0.954 0.996 
6 1 0.534 0.903 0.981 0.988 0.973 
2 9 1 0.218 0.453 0.745 0.754 0.916 
4 1 0.355 0.443 0.897 0.777 0.934 
10 1 0.082 0.185 0.904 0.803 0.923 
12 1 0.067 0.118 0.968 0.967 0.998 
3 2 1 0.176 0.307 0 0.813 0.948 
13 1 0 0.006 0.082 0.879 0.987 
4 7 1 0.204 0.306 0.251 0.559 0.941 
8 1 0.395 0.508 0.352 0.51 0.905 
11 1 0.067 0.319 0.346 0.537 0.964 
14 1 0 0 0.011 0.037 0.907 
Number of students 136 228 85 235 352 
Latent class probability (%) 13.13 22.01 8.21 22.68 33.98 
D Springer 
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Table 7 Numbers of students and AMPs in each level 


AMP ID Al A2 A3 A4 A5 A6 A7 LevelO Levell Level2 Level3 Level 4 


40 x x x x x x x 320 
39 x x x x x x 17 99 

38 x x x x x 27 16 26 

37 x x x x x 27 

36 x x x x 14 

35 x x X X x X 89 23 
34 x x x x x 16 

33 x x x x x x 9 
32 x x x x x 18 

30 x x x X 27 

29 x x X x 25 

26 x x x x 7 

25 x x x 12 

22 x x 10 

21 x x x x 26 

20 x x x X x 14 

19 x x x 9 

14 x x 9 

13 x x x 7 

12 x x X x 8 

10 x x 13 

9 x x 8 

8 x x 38 15 


The total number of students in each level 121 182 60 214 352 


We also examined students’ attribute master probability of each level (Table 8). When 
judging whether students have mastered some attributes, we set 0.5 (p ) as the criterion, which 
means students have a 50% opportunity to correctly acquire a given attribute. Results show 
that students at level 0 only understand A3. When students progress to level 1, they can grasp 
Al, A2, A3, A4, and A7. Students in levels 2 and 3 have mastered the same attributes: Al, A2, 
A3, A4, A5, and A7. Students in level 4 can master all seven attributes. 

Therefore, a modified learning progression showing the progress of learning buoyancy was 
obtained (Table 9). It is somewhat different from the hypothesized learning progression, 
especially for levels 0, 1, and 2. Specifically, we assumed that students at level 0 can only 
master Direction based on their common experience. However, students at this level can only 
grasp Density, which has been taught before the learning session of buoyancy. Compared to 
students at level 0, level 1 students achieved significant progress. They mastered Direction, 
Identification, Submerged volume, and Relative Density along with Density. This is not 
consistent with our hypothesis that assumed students at this level can only master Direction, 
Density, and Relative Density. Archimedes’ theory can be regarded as an important sign when 
judging whether students progress to level 2. Since students have mastered Identification at 


Table 8 Attribute master proba- 
bility (p’) of each level Level Al A2 A3 A4 A5 A6 A7 


0 0.43 0.37 0.86 0.38 0 0.07 0.37 
1 0.54 0.70 1.0 0.69 0.19 0.30 0.82 
2 0.73 0.55 1.0 1.0 0 1.0 1.0 
3 0.88 1.0 1.0 1.0 0.42 0.58 1.0 
4 1.0 1.0 1.0 1.0 1.0 0.93 0.97 
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Table 9 Modified learning pro- 


gression and its corresponding Level Al A2 A3 A4 AS A6 AT 
attributes — 
0 x 
1 x x x x x 
2 x x x x x x 
3 x x x x x x x 


level 1, students in levels 2 and 3 cannot be distinguished as we assumed only students in level 
3 or above can master Identification. Thus, we combine the original levels 2 and 3 into one 
level—level 2. Accordingly, level 4 was modified as level 3, which is the level where students 
have mastered all seven attributes. 


Discussion 
Modeling Conceptual Change by a Learning Progression 


By employing quantitative methods, this study empirically validated the cumulative charac- 
teristics of conceptual change. This result was consistent with prior studies (diSessa 2007, 
2013). However, several new results were also found. First, we modeled the conceptual change 
process by a learning progression. This learning progression approach, by decomposing the 
attributes of the concept of buoyancy, was able to locate not only the starting point and the 
ending point of the conceptual change but also the incremental steps students pass through. In 
the current study, students’ progressions were modeled by examining how many attributes 
they mastered. For example, students at level 0 only mastered one attribute, whereas five 
attributes were mastered in level 1, six in level 2, and seven in level 3. This result indicates that 
students’ conceptual change happens as they understand more attributes of buoyancy, which 
essentially accords with studies exploring the topic “Why Things Sink or Float” (Kennedy and 
Wilson 2007; Yin et al. 2014). Second, this study provided quantitative evidence to support the 
cumulative characteristic of conceptual change. Compared with prior studies which mainly 
employed theoretical or qualitative methods (Magnusson et al. 1997; Vosniadou and Brewer 
1992), this study quantitatively depicted how students’ conceptual change happened. Further- 
more, a large sample size ensured the reliability of the results. 


Verifying the Learning Progression of Buoyancy 


By employing latent class analysis and rule space model analysis, we refined our initial 
learning progression of buoyancy. First, as mentioned above, the expert panel hypothesized 
that the students in level 0 only mastered Direction, but in our study, we found that the lowest 
level students only understood Density. This disaccord should be carefully interpreted. One 
possibility is that Density is indeed much easier than Direction as our finding shows due to the 
learning sequence (Chen et al. 2016). Density is defined as a property of an object determined 
by its mass and volume. Students in this study were taught density at the first semester of the 
7th grade. In contrast, they were taught the other six attributes at the first semester of the 8th 
grade. Thus, Density is easiest among these seven attributes and students in level 0 grasped 
only this attribute. Another possibility for the unexpected result could be the nature of the 
items. In this test, 5 of 14 items have difficulties that are greater than 0.7. We examined them 
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and found that three items included density. Therefore, it is likely that these items are too easy 
to effectively evaluate the attribute of density. 

When students progress to level 1, they can grasp two more attributes—IJdentification 
and Submerged volume—compared to what the panel assumed. Identification means that 
students can identify not only gravity but also buoyancy. It directly contributed to the 
mastery of Relation with motion, which indicates that students can analyze the magnitude 
of buoyancy according to the state of motion. Considering that students have learned 
balanced forces at the second semester of the 7th grade, it can be easily transferred to 
Identification, which analyzes buoyancy and gravity, even though students have pre- 
instructional conceptions before formal instruction (Sahin and Cepni 2012; Unal and 
Costu 2005). So Identification is located in level 1. As for Submerged volume, it is the 
foundation of Archimedes’ theory. Considering the hierarchical property of these two 
attributes, the previous operation of putting them into one level—level 2—is not reason- 
able. This is because higher hierarchical level concepts are more difficult to learn (She 
2002). As our result shows, students gradually mastered these concepts—Submerged 
volume in level 1 and Archimedes’ theory in level 2. What is more, the Submerged volume 
can be understood by a qualitative model, whereas Archimedes’ theory must be grasped by 
a quantitative model. Clement (2008) claimed that the quantitative mental model was more 
complex than the qualitative mental model. Therefore, we put Submerged volume in level 
1 instead of level 2. 

Finally, the results showed that students had the same attribute mastery pattern in 
original levels 2 and 3. The panel divided level 2 and level 3 by Jdentification in the 
hypothesized learning progression. In the modified learning progression, Identification 
can be mastered by students at level 1 and above, so students in original levels 2 and 3 
cannot be distinguished any more. Thus, we combined original levels 2 and 3 into one 
level—level 2—and reduced the five-level hypothesized learning progression into a 
modified four-level learning progression. 

Accordingly, we arrived at a revised explanation model: Qualitative—Quantitative— 
Integrative. Compared with the initial explanation model, we exclude the Intuitive part of 
the model, which described some attributes that are easy to learn by common experience. 
There are two possible reasons why students do not give priority to Direction. The first 
one is that students might know the direction of buoyancy is upward from their everyday 
experience. However, they might confuse the accurate direction, such as whether it is 
perpendicular to the ground or perpendicular to the container. The second possibility is 
that items involving direction are too difficult. We examined the Buoyancy test and 
found that seven items involved the direction concept, while four of them also examined 
other difficult attributes, such as A5, which results in the inaccurate inference about the 
difficulty of the direction concept. The attributes in the new level 0 appear to result from 
a prior-learning effect and they can be explained by a Qualitative model together with 
attributes in level 1. When students get into level 2, they can calculate buoyancy by 
Archimedes’ theory and the Quantitative explanation model is applicable. At last, stu- 
dents in level 3 can master the attribute of Relation with motion and the Integrative 
explanation model is also suitable. 

In this study, we firstly provided a new perspective for determining the grain size in a 
learning progression. Grain size can be defined as the content of each level or as the size of the 
shift between levels (Alonzo and Gotwals 2012). No single grain size is suitable for all 
learning progressions and it is mainly determined by the aim of the learning progression. 
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Teachers and curriculum developers tend to need a fine-grained learning progression to 
identify students’ weaknesses. The content of attributes we used as grain size in our work is 
quite applicable to such a case. Second, Archimedes’ theory and Relation with motion are the 
key attributes for students to fully understand buoyancy. Teachers should give more instruc- 
tions to facilitate the understanding of these attributes and achieve the desired conceptual 
change (Hardy et al. 2006). Actually, there are already some existing studies focusing on the 
phenomenon of objects’ floating and sinking (Kennedy and Wilson 2007; Yin et al. 2014). But 
their results may be not applicable for Chinese students because Kennedy and Wilson (2007) 
and Yin et al. (2014) paid much attention to density and relative density. In Chinese textbooks, 
students learn buoyancy from the perspective of force. Direction, magnitude, and application 
point are basic elements of force. When it comes to the topic of buoyancy, science or physics 
teachers give instructions in identifying the direction and calculating the magnitude of 
buoyancy. Compared with the contents in some researches (Kennedy and Wilson 2007; Yin 
et al. 2014), relative density is only a sub-concept which can be derived from the Archimedes’ 
theory in China. Thus, we need to include other attributes such as Archimedes’ theory and 
Relation with motion besides Density and Relative density. This finding provides more 
evidence for scholars and teachers to understand how students’ conceptual change of buoy- 
ancy happens, and leads to specific instructional hints for physics or science teachers. Thirdly, 
compared with previous studies which only applied latent class analysis (Fulmer et al. 2014; 
Steedle and Shavelson 2009) or only used the rule space model (Chen et al. 2016, 2017), we 
used both approaches. We can summarize the benefits of such an analysis in the following 
way. We first used latent class analysis to group the cohort of students into more objective 
levels compared with Chen et al. (2016) and Chen et al. (2017). Furthermore, we used the rule 
space model analysis to provide more detailed evidence of the attributes in each level 
compared with Fulmer et al. (2014). 

However, it is necessary to point out limitations in this work and steps we are currently 
devoted to. The first limitation is the difficulty of the attributes we judged. The attribute 
difficulty can be influenced by the characteristics of the items used. If tested only by difficult 
items, the judgment of the difficulty of an attribute will be overestimated, just as Al in our 
work. One solution is to balance the number of difficult items and easy items. Second, the 
validity of the revised learning progression has not yet been supported by implementation in 
the classroom. Learning progression is a powerful framework for improving science teaching 
and student learning. Future studies should design experiments to compare traditional teaching 
group students with learning-progression-based group students. 


Conclusion 


We have made progress toward modeling the cumulative characteristic of conceptual change 
by developing a learning progression of buoyancy. Overall, the conceptual change of buoy- 
ancy is modeled by a four-level learning progression and students’ progression to higher levels 
is accompanied by an increased number of mastered attributes. Students at level 0 only 
understand Density. When students progress to level 1, they can grasp Direction, Identification, 
Submerged volume, and Relative density on the basis of the prior level. Then, students 
gradually master Archimedes’ theory and reach level 2. The most advanced students can grasp 
Relation with motion and get into level 3. The Qualitative—Quantitative—Integrative model 
accounts for the four-level learning progression well. 
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Appendix 
Buoyancy Test 
School Class 1 
Name Student Number Gender n Boy o Girl 


Instruction: Welcome to the Buoyancy Test. This test consists of an array of items which are related 
to the concept of buoyancy. You should try your best to complete it. Thank you very much! 


1. When an object is put into a container full of water, it sinks. What is the direction of buoyancy 
during its sinking? 
A. Vertically downward C. Vertically upward 
B. Downward but it is perpendicular to the container D. No buoyancy 


2. Draw the force diagrams for a ball in each of the following states and compare the forces of 


gravity and buoyancy. 


3. There are three objects all with a uniform mass distribution. Which of these objects has the 


greatest density? 
Object Mass Volume 
1 m V 
2 m 2V 
3 2m V 
A. Object 1 C. Object 3 
B. Object 2 D. It cannot be determined 


4. There are four same containers, of which the left parts are full of water and the right parts are 
empty (see the picture below). If we place four balls with the same volume into the left parts, water 
would flow into the right parts. According to the final states of these balls, which of the following 


choices represents the correct comparison among water volumes in the right parts? 


1 2 3 4 
OE nE ? 
A. Vi=V2=V;3=V4 C. V2=V3>Vi> V4 
B. V2>V3>V1>V4 D. Vi=V4>V2=V3 
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10. 


Block A sinks in container with water (see the picture below). As for the density of Block A, 


which of the following is most likely? 


A. 0.3x103 kg/m? C. 0.8103 kg/m? 


B. 0.5x10? kg/m D. 1.1x10° kg/m? 


James puts one egg into a container with water, and this egg sinks to the bottom. If James wants to 
make this egg float, which of the following operations might be feasible? 

A. Adding water C. Adding alcohol 

B. Adding salt D. Evaporating water 


If we put one ball into different liquids, it would float, hang, and sink in these liquids (see the 


picture below). As for its buoyancies, which of the following comparisons is right? 


A. Fi, >Fo.>F3 C. F) >Fo=F3 
B. F\=F.>F; D. Fı<Fı<F; 


Object 1, Object 2, Object 3, and Object 4 have different shapes, but they have the same mass. 


According to their states in water (see the picture below), which of these objects has the smallest 


buoyancy? 
A. Object 1 C. Object 3 
B. Object 2 D. Object 4 


Block 1, Block 2, and Block 3 have the same mass, but they are made 
of different materials: copper, iron, and aluminum (p copper”? iron>P aluminum). If we put these blocks 
into three same containers which are full of water, they would sink and the water would flow out. 


Which of these three circumstances has the greatest overflow water? 
A. Copper C. Aluminum 


B. Iron D. All are same 


There is a big container which is full of water. If we put a ball whose mass is 0.3kg in it, the mass 
of overflow water is 0.1kg. What’s the magnitude of its buoyancy? 

A. IN C. 3N 

B. 2N D. 4N 
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11. A block is made of wood with the density of 0.6x10°kg/m’ and the mass of 0.3kg. If we place it in 
enough water, what’s the magnitude of buoyancy? 


A. 3N C. 5N 
B. 6N D. It cannot be determined 


12. A block is made of icon with the density of 7.8x10°kg/m? and the mass of 0.39kg. If we place it in 
enough water, what’s the magnitude of buoyancy? 
A. 7.8N C. 3.9N 
B. 0.5N D. It cannot be determined 


13. There is a wooden block floating in water. The volume of this block is 1 x 10°m’, and the 
submerged volume accounts for 2 of its whole volume. Which of the following options is right 


about the magnitude of buoyancy and its density? 
A. 4; 0.4x10° C. 2; 0.2x103 


B. 5;0.5x103 D. It cannot be determined 


14. Two identical blocks which are made of paraffin are placed into sufficient amounts of water and 
alcohol. What is the ratio of the blocks’ submerged volumes in these liquids? (p 
paraffin=0.9* 1 0°kg/m?3 >P alcoho! =0.8X 10°kg/m’) 


A. 9:8 C. 8:9 
B. 1:1 D. It cannot be determined 
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